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Background 

Digital Imaging and Communications in Medicine (DICOM) is a medical image 
standard for communication of biomedical diagnostic and therapeutic information in 
disciplines that use digital images and associated data. By using a medical image 
standard such as DICOM, medical image data can be shared and used among compliant 
devices, such as imaging systems and workstations. A typical use of DICOM is with 
two-dimensional ("2D") ultrasound images that are archived as a simple sequence of 
video images. Because the image data is typically processed, post-scan converted data, 
once 2D ultrasound images are stored, none of the post-processing capabilities normally 
available on the ultrasound system (such as gray-scale maps, edge enhancement, and 
video filters) are available to enhance the 2D image. This provides the benefit of 
ensuring that the archived image reproduces as closely as possible what the clinician who 
stored the image was viewing at the time the image was archived. 

Recent advances have generated a desire to store and later manipulate other forms 
of image data. For example, in the emerging field of real-time three-dimensional ("3D") 
imaging (sometimes referred to as 4D, or Live-3D), clinicians would like to be able to 
apply post-processing functions to archived images, such as extracting a 2D image from a 
three-dimensional data set (Le., multi-planer reconstruction ("MPR")) and viewing a 3D 
image from different angles. In addition to these 3D-specific post-processing functions, 
clinicians would also like to apply conventional 2D functions, such as gray-scale 
remapping, edge enhancement, and speckle reduction, to 3D images. 

Although DICOM-compliant image viewers are not capable of displaying and/or 
manipulating these other forms of image data, the "private attribute" field in DICOM can 
be used to transmit non-standard image data from one DICOM device to another. Many 
ultrasound system manufacturers have taken advantage of this field to transmit data that 
cannot be stored in the DICOM format from a DICOM-compliant ultrasound system to a 
DICOM-compliant workstation. The workstation may have proprietary software 
installed to enable the workstation to utilize this non-DICOM data, or the workstation 
may simply ignore the non-DICOM data. 
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Summary 

The present invention is defined by the following claims, and nothing in this 
section should be taken as a limitation on those claims. 

By way of introduction, the embodiments described below relate to methods and 
5 systems for displaying and/or manipulating medical image data. In one embodiment, a 

medical image viewer in compliance with a medical image standard is provided, and a 
file in compliance with the medical image standard is provided to the medical image 
viewer. The medical image standard specifies a first field for data not in compliance with 
the medical image standard and a second field for data in compliance with the medical 
10 image standard. The first field of the file comprises medical image data, and the second 

field of the file comprises information that can be used to obtain software to at least one 
of display and manipulate the medical image data. The software is obtained, and at least 
one of the following is performed with the software: displaying the medical image data 
and manipulating the medical image data. Other embodiments are provided, and each of 
15 the embodiments described herein can be used alone or in combination with one another. 

The embodiments will now be described with reference to the attached drawings. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a medical diagnostic ultrasound imaging system of 
an embodiment. 

20 Figure 2 is a block diagram of a medical image viewer of an embodiment. 

Figure 3 is an illustration of a medical image standard of an embodiment. 

Figure 4 is an illustration of a display device displaying a message of an 
embodiment instructing a user of a medical image viewer how to obtain software. 

Figure 5 is an illustration of a display device displaying a link of an embodiment 
25 to a network location storing software. 

Detailed Description of the Presently 
Preferred Embodiments 

By way of introduction, the embodiments described below relate generally to 
diagnostic medical images. Although any type of medical image can be used, these 



embodiments will be illustrated in conjunction with ultrasound images. As noted in more 
detail below, other types of medical images can be used, and the following claims should 
not be limited to ultrasound images unless explicitly recited therein. 

Turning now to the drawings, Figure 1 is a block diagram of an ultrasound system 
100 of an embodiment. The ultrasound system 100 comprises a transducer probe 105, a 
beamformer 1 10, a signal processing and detection component 120, a reconstruction and 
3D rendering component 130, and a display monitor 140. The ultrasound system 100 
also comprises a medical image data storage component 150, which can capture image 
data at one or more locations along the image path, a hard disk 160, removable media 170 
(e.g., a CD, an MO disk, etc.), a network I/O port 180, and a wireless communication 
device 190. The various components 110, 120, 130, 150 in the ultrasound system 100 
can be implemented with dedicated hardware devices and/or one or more processors 
running software. 

It is important to note that different ultrasound systems can be configured 
differently from the one shown in Figure 1 . For example, while the medical image data 
storage component 150 in the ultrasound system 100 in Figure 1 is shown as being 
capable of capturing image data at three locations in the image path, medical image data 
storage components in other ultrasound imaging systems can be designed to capture 
image data at only one or two of the shown locations or at a different location in the 
image path not shown in Figure 1 . As another example, although there are three data 
output components shown in Figure 1 (removable media 170, the network I/O 180, and 
the wireless communication device 190), more or fewer or different components can be 
used to export image data. 

During an ultrasound examination, a sonographer contacts the transducer probe 
105 with a patient, and the beamformer 110 applies a voltage to the transducer 105 to 
cause it to vibrate and emit an ultrasonic beam into the portion of the patient's body in 
contact with the transducer 105, Ultrasonic energy reflected from the patient's body 
impinges on the transducer 105, and the resulting voltages created by the transducer 105 
are received by the beamformer 110. The beamformer 110 produces image data referred 
to as "RF data" and sends this image data to the signal processing and detection 
component 120. The signal processing and detection component 120 is used to at least 
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detect the amplitude of the beamformer output and provide this amplitude to the 
reconstruction and rendering component. In addition to this amplitude detection, the 
signal processing and detection component may also be used to filter the signal in both 
range and lateral dimensions (azimuth for a one-dimensional transducer, azimuth and 

5 elevation for a two dimensional transducer), as well as providing the capability to 

synthesize signals by combining signals from more than one transmit event before 
amplitude detection and a compounding capability by combining signals from more than 
one transmit event after amplitude detection. The image data outputted by the signal 
processing and detection component 120 is provided to the reconstruction and 3D 

10 rendering component 130, which is where the echo amplitude data is converted into an 

image format such as a two-dimensional video frame (2D reconstruction) or is 
reconstructed into a three-dimensional volume data set (3D reconstruction) and then 
processed for display (3D rendering). 

The medical image data storage component 150 captures image data from one or 

15 more points along the image path. The term "image data" refers to any data along the 

image path from the transducer probe 105 to the display monitor 140. Most ultrasound 
systems capture image data after the reconstruction and 3D rendering component 130. 
This data, which is DICOM compliant, consists only of 2D images or 2D renderings of 
3D data. The image data outputted by the signal processing and detection component 

20 120 could be 2D image data or 3D image data before scan conversion or reconstruction. 

This image data is not readable by DICOM-compliant devices such as DICOM 
workstations. Further, although current commercial ultrasound systems do not store RF 
data due to storage capacity and network bandwidth limitations, the embodiments 
described herein can be used with RF data. Also, while Figure 1 shows the medical 

25 image data storage component 150 capable of capturing image data at three points in the 

image path, the medical image data storage component 150 can be designed to capture 
image data at fewer or more points. The captured image data can be stored in the 
ultrasound system's hard disk 160 and/or removable media 170. The captured image data 
can also be exported from the ultrasound system 100 via the network I/O 180 (e.g., across 

30 an intranet or the Internet) or via the wireless communication device 190. 



The ultrasound system 100 operates in compliance with a medical image standard 
and sends captured medical image data to another device operating in compliance with 
the medical image standard. In general, a medical image standard specifies the format of 
archiving and transmitting image data. A medical image standard can also specify the 
behavior of software when it encounters an image file in a format in compliance with the 
standard. Although any medical image standard now existing or developed in the future 
can be used, the DICOM standard will be used to illustrate this embodiment. In 
operation, the medical image data storage component 150 packages the medical image 
data in a file that is sent to a medical image viewer via removable media 170, the network 
I/O 180, or the wireless communication device 190. As used herein, the term "medical 
image viewer" broadly refers to any device that can be used to view and/or manipulate 
medical image data. Examples of medical image viewers include, but are not limited to, 
dedicated workstation (i.e., image review stations), general-purpose computers, personal 
digital assistants, cell phones, and set-top boxes. A medical image viewer can also be a 
medical imaging system (e.g., an ultrasound system) different from the one used to 
generate the medical image data. 

Figure 2 is a block diagram of a medical image viewer 200 of an embodiment. As 
shown in Figure 2, the medical image viewer 200 comprises a processor 210 in 
communication with removable media 220, a network I/O 230, and a wireless 
communication device 240 that interfaces with the ultrasound system's removable media 
170, network I/O 180, and a wireless communication device 190, respectively. The 
medical image viewer 200 also comprises a storage device 250 that can store the 
transferred medical image data file (and/or computer-readable program code executable 
by the processor 210), a display device 260, and a user interface 270. 

Because the ultrasound system 100 and medical image viewer 200 operate in 
compliance with the same medical image standard, medical image data that is in 
compliance with the medical image standard can be viewed by the medical image viewer 
200 (i.e., the processor 210 of the medical image viewer 200 runs medical-image- 
standard-compliant viewing software). With this embodiment, the medical image viewer 
200 can also display and/or manipulate medical image data that is not in compliance with 
the medical image standard (e.g., RF data, pre-scan converted data, pre-reconstruction 



data, and a three-dimensional data set). This embodiment achieves this by incorporating 
capabilities and information required for viewing and/or manipulating medical images 
into the image data file sent to the medical image viewer 200. This will be discussed in 
more detail with reference to Figure 3. 

As shown in Figure 3, the medical image standard specifies that a file associated 
with medical image data have a first field 310 and a second field 320 (the medical image 
standard can also specify additional fields not shown in Figure 3 for simplicity). The first 
field 310 is for data that is not in compliance with the medical image standard, and the 
second field 320 is for data that is in compliance with the medical image standard. In the 
DICOM medical image standard, the first field 310 is the DICOM private attribute, and 
the second field 320 is the DICOM standard attribute. The first field 310 comprises the 
non-compliant medical image data, and the second field 320 comprises information that 
can be used to obtain software to display and/or manipulate the medical image data stored 
in the first field 310. As used herein, the phrase "information that can be used to obtain 
software" broadly refers to any information that can be used to manually or automatically 
obtain software that can be executed on the processor 210 of the medical image viewer 
200 to display and/or manipulate the medical image data in the first field 310. 

One example of such information is a message that instructs a user of the medical 
image viewer 200 how to obtain the software. When the file is received by the medical 
image viewer 200, the medical-image-standard-compliant software reads the data in the 
second field 320 and displays the data on the display device 260. As shown in Figure 4, 
one suitable message 400 can be "The medical image data you are attempting to access is 
in a proprietary format. Using your Internet browser, please visit the Siemens web site to 
download the software needed to access the medical image data." In response to this 
message, the user can execute his Internet browser, which can be a separate application 
from the medical-image-standard-compliant software, to download the required software. 
The advantage of this approach is that it does not require any new special capability from 
the DICOM workstation. In this way, instructions on how to obtain proprietary software 
can be stored without having to have any special capabilities on the workstation. 
To save the user time, the information in the second field can comprise a link to a 
network location storing the software. For example, as shown in Figure 5, the message 



500 displayed to the user can include a link 510 that, when selected by the user, will 
cause the medical-image-standard-compliant software or Internet browser to download 
the software. As a further time-savings measure, the information in the second field can 
be computer-instruction code that automatically causes the medical-image-standard- 
compliant software or the Internet browser to download the needed software. While the 
term "Internet" has been used in these examples, it should be noted that the software can 
be stored on an intranet location, such as on a local server in a hospital intranet. These 
approached may require an extension to the DICOM standard. 

If network resources are not available (e.g., when the medical image viewer 200 is 
not connected to a network and receives medical image data files via removable media 
220), the information in the second field 320 can be a message informing the user of a 
telephone number, fax number, or postal address to which a verbal or written request for 
the software can be made. In yet another alternative, the required software can be 
resident on the medical image viewer 200 in a hidden form, and the information in the 
second field 320 can be used to "obtain" the software by removing the restrictions on its 
use. Accordingly, the term "obtain" should be interpreted broadly and does not 
necessarily mean download via a network. Further, with any of these embodiments, the 
user (or owner) of the medical image viewer 200 can be charged a fee for obtaining the 
software. 

Once the software is obtained, it can be used to display and/or manipulate the 
medical image data in the first field 310. For example, if the medical image data is a 
three-dimensional data set that is captured in the image path between the signal 
processing and detection component 120 and the reconstruction and 3D rendering 
component 130, the obtained software can be used to extract a 2D image from the three- 
dimensional data set (i.e., multi-planer reconstruction ("MPR")), create a 3D image from 
the data set and view the 3D image from different angles, and apply conventional 2D 
functions, such as gray-scale remapping, edge enhancement, and speckle reduction, to the 
3D image. It should be noted that the obtained software can be used in conjunction with 
or separate from the medical-image-standard-compliant software running on the medical 
image viewer 200. Further, the medical-image-standard-compliant software can already 
allow some types of display and/or manipulation of non-medical-image-standard 
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compliant data, with the obtained software providing additional functionality. Also, the 
obtained software can contain features other than those used to display and/or manipulate 
the image data. In one embodiment, the obtained software was not installed or available 
to the image viewer 200 prior to receiving the medical image file with the information 
regarding how to obtain the software. 

In summary, the embodiments described herein incorporate capabilities and 
information required for viewing and/or manipulating medical images into the image data 
file sent to a medical image viewer. These embodiments can be used to allow a user to 
store medical image data that is not in an industry standard format (such as DICOM) and 
provide information that can be used to obtain the appropriate software to display and/or 
manipulate this data. One advantage associated with these embodiments is that they 
provide a "plug-and-play" like capability for processing medical image data that is not in 
compliance with the medical image standard. These embodiments find particular use 
with the DICOM format, in that non-DICOM data (such as large 3D/4D datasets, pre- 
reconstructed data, or RF data) stored in the DICOM private attribute tag can be viewed 
and/or manipulated using a DICOM-compliant viewer with software obtained using 
information stored in the DICOM standard attribute tag. (Data from the Ultrasound 
Research Interface (URI), which allows a user to capture certain types of data, currently 
limited to RF or I/Q data, can also be used. In general, non-DICOM data can be any 
intermediate data from element data to display data.) In this way, if a user attempted to 
open a DICOM file containing non-DICOM data while on an image review station that 
had no capability to view and/or manipulate the non-DICOM data, the DICOM data 
would assist the user (such as by displaying a message instructing him to download the 
appropriate software) in order to "upgrade" his generic review station to one capable of 
manipulating (e.g., reconstructing) and viewing the non-DICOM image data. In this way, 
many (if not all) of the manipulations performed by an ultrasound system on a data set 
can be performed off-line on another ultrasound system or a workstation without pre- 
loading the off-line system with software prior to receiving the data set. This allows for a 
different model for archiving images to be created that moves away from archiving 2D 
ultrasound images as a simple sequence of video images. Further, these embodiments 
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can be configured such that anyone with a DICOM viewing station can access non- 
compliant image data irrespective of which manufacturer's system generated the data. 

As noted above, each of the embodiments described herein can be used alone or 
in combination with one another. As also noted above, these embodiments can be used 

5 with image modalities other than ultrasound imaging, and the claims should not be 

limited to any particular type of image modality unless explicitly recited therein. 
Examples of different types of image modalities that can be used with these embodiments 
include, but are not limited to, computed tomography (CT), magnetic resonance imaging 
(MRI), computed radiography, magnetic resonance, angioscopy, color flow Doppler, 

10 cystoscopy, diaphanography, echocardiography, fluoresosin angiography, laparoscopy, 

magnetic resonance angiography, positron emission tomography, single-photon emission 
computed tomography, x-ray angiography, computed tomography, nuclear medicine, 
biomagnetic imaging, culposcopy, duplex Doppler, digital microscopy, endoscopy, 
fundoscopy, laser surface scan, magnetic resonance spectroscopy, radiographic imaging, 

1 5 thermography, and radio fluroscopy . 

It is intended that the foregoing detailed description be understood as an 
illustration of selected forms that the invention can take and not as a definition of the 
invention. It is only the following claims, including all equivalents, that are intended to 
define the scope of this invention. 
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